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Abstract 

In this paper we present an abstract convergence analysis of inexact descent meth- 
ods in Riemannian context for functions satisfying Kurdyka-Lojasiewicz inequahty. In 
particular, without any restrictive assumption about the sign of the sectional curvature 
of the manifold, we obtain full convergence of a bounded sequence generated by the 
proximal point method, in the case that the objective function is nonsmooth and non- 
convex, and the subproblems are determined by a quasi distance which does not neces- 
sarily coincide with the Riemannian distance. Moreover, if the objective function is 
with L-Lipschitz gradient, not necessarily convex, but satisfying Kurdyka-Lojasiewicz 
inequality, full convergence of a bounded sequence generated by the steepest descent 
method is obtained. 
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1 Introduction 



Consider the following minimization problem 



min f{x) 
s.t. X e M, 



(1.1) 



where M is a complete Riemannian manifold and / : M — )• RU{+oo} is a proper lower 
semicontinuous function bounded from below. The exact proximal point method to solve 
optimization problems of the form (1.1) generates, for a starting point e M, a sequence 
{x''} C M as follows: 



where {A^} is a sequence of positive numbers and d is the Riemannian distance (see Section 2 
for a definition). This method was first considered in this context by Ferreira and Oliveira 
[18], in the particular case that M is a Hadamard manifold (see Section 2 for a definition), 
dom/ = M and / is convex. They proved that, for each /c e N, the function /(.) + 
(P{.,x^) : M — >■ M is 1-coercive and, consequently, that the sequence {x''} is well-defined, 
with x'''^^ being uniquely determined. Moreover, supposing Xlfe^lZ-^fe = +oo and that / 
has a minimizer, the authors proved convergence of the sequence {f{x'')} to the minimum 
value and convergence of the sequence {x'^} to a minimizer point. Li et al. [31] extended this 
method for finding singularity of a multivalued vector field and proved that the generated 
sequence is well-defined and converges to a singularity of a maximal monotone vector field, 
whenever it exists. 

In the last three decades, several authors have proposed the generalized proximal point 
method for certain nonconvex minimization problems. As far as we know the first direct 
generalization, in the case that M is a Hilbert space, has been performed by Fukushima 
and Mine [19]. See Kaplan and Tichatschkc [24] for a review. For the problem of finding 
singularities of multivalued operators, that situation is similar to the case where there is no 
monotonicity (e.g. where the operator is hypomonotone) , see e.g., Spingarn and Jonathan 
[41], Pennanen [37], lusem et al. [23], Combettes and Pennanen [13], Garciga and lusem 
[21]. In the Riemannian context. Papa Quiroz and Oliveira [35] considered the proximal 
point method for quasiconvex function (not necessarily convex) and proved full convergence 
of the sequence {x^} to a minimizer point with M being a Hadamard manifold. Bento et 
al. [7] considered the proximal point method for C^-lower type functions and obtained local 
convergence of the generated sequence to a minimizer, also in the case that M is a Hadamard 
manifold. 



x''+^ e argmin^e^ {f{y) + Xk(f{y,x^ 



(1.2) 
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So far, in the convergence analysis of the exact proximal point method for solving either 
convex minimization problems (resp. find singularities of monotone vector field) how non- 
convex minimization problems, it was necessary to consider Hadamard type manifolds. This 
is because the convergence analysis is based on Fejer convergence to the minimizers set of 
/ (resp. to the singularities set of the vector field), and these manifolds, apart from having 
the same topology and structure differentiable from Euclidean space, also have geometric 
properties satisfactory to the characterization of Fejer convergence of the sequence. 

In the Riemannian context we raise the following issue: 

Problem 1. Would it be possible to obtain the convergence of the whole sequence gener- 
ated by the method (1.2) for f not necessarily convex or quasiconvexa, and M not necessarily 
Hadamard? 

Considering again Problem (1.1) now with / continuously differentiable and dom/ = M, 
given x^ & M the classic steepest descent method generates a sequence {x''} given by 

x*^+^ = exp,.(-ifcgrad/(x'=)), (1.3) 

where cxp is the exponential map and t^ is some positive stcpsize. As far as we know, this 
method was first studied by Luemberger [32] and later by Gabay [20] both in the particular 
case where M is the inverse image of regular value. Udriste [42], Smith [40], Rapcsak [38] 
also studied whose method in the case that M is a any complete Riemannian manifold and 
partial convergence results were obtained. For the convex case, the full convergence, using 
Armijo's rule and 'fixed step' was obtained by da Cruz Neto et al. [15], in the particular case 
where M has nonnegative sectional curvature. Regarding the same restrictive assumption on 
the manifold M, Papa Quiroz et al. [36] proved a full convergence result using a generalized 
Armijo's rule for the quasiconvex case. Note that the results of convergence presented in 
[15] (resp. [36]) for the steepest descent method for solving convex minimization problems 
depend, besides the assumption of convexity (resp. quasi-convcxity) on function /, of the sign 
of the sectional curvature of M. This is because the convergence analysis is based on quasi- 
Fejer convergence to the minimizers set of / and these manifolds have geometric properties 
favorable to the characterization of the quasi- Fejer convergence of the sequence. 
In the same context of Problem 1, we raise the following issue: 

Problem 2. Would it be possible to obtain the convergence of the whole sequence gener- 
ated by the method (1.3) for f not necessarily convex or quasiconvexa, and without restrictive 
assumption on the sign of the sectional curvature of the manifold M ? 

This paper has the same spirit of the work of Alvarez et al. [3] in which the authors 
proved a unified result for the existence and local uniqueness of the solution, and for the 
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local convergence of a Riemannian version of Newton's method. Here we are interested in 
providing an unified framework for the convergence analysis of classical descent methods 
which, in particular, includes the methods (1.2) and (1.3), and answer Problems 1 and 2. 
To achieve this goal, we assume, as main assumption, that the objective function satisfies a 
well-known property as Kurdyka-Lojasiewicz inequality. This inequality was introduced by 
Kurdyka [26], for differentiable functions definable in an o- minimal structure defined in R", 
through the following result: 

Given f/ C M" a bounded open set and g : U ^ a differentiable function definable 
on a o-minimal structure, there exists c,ri > and a strictly increasing positive function 
definable ip : M+ M. of class , such that 

\\V{^og){x)\\>c, xeUng-\0,ri). (1.4) 

Note that taking ip{t) = a e [0, 1), the inequality (1.4) yields 

\\Vg{x)\\>c\g{x)r, (1.5) 

where c = 1/(1 — a), which is known as Lojasiewicz inequality, see [29]. Absil et al. [1] 
established an abstract result of convergence for sequences (satisfying a strong descent con- 
dition) in the case where the objective function is analytic, defined on M", which satisfies 
(1.5). For extensions of Kurdyka-Lojasiewicz inequality to subanalytic nonsmooth functions 
(defined in Euclidean spaces) see, for example, Bolte et al. [9] , Attouch and Bolte [4] . A more 
general extension, yet in the context Euchdean, was developed by Bolte et al. [10] mainly 
for Clarke's subdifferentiable of a lower semicontinuous function definable in an o-minimal 
structure. Also in the Euclidean context, Attouch et al. [5] presented a general conver- 
gence result for Inexact gradient methods in the case that the objective function satisfies 
(1.4). Lageman [28] extended the Kurdyka-Lojasiewicz inequality (1.4) for analytic mani- 
folds and differentiable C-functions in an analytic-geometric category (satisfying a certain 
descent condition, namely, angle and Wolfe-Powell conditions) and established an abstract 
result of convergence of descent method, see [28, Theorem 2.1.22]. In particular, Lageman 
observed that the answer to Problem 2 is positive (see Example of Theorem 2.1.22, page 
96 of [28]). It is important to note that Kurdyka et al. [27] had already estabhshed an 
extension of the inequality (1.5) for analytic manifolds and analytic functions to solve R. 
Thom's conjecture. 

The paper is organized as follows. In Section 2 we recorded some basic definitions and 
results of the theory of Riemannian manifolds. In Section 3 we present elements of nonsmooth 
analysis on manifold. In Section 4 we present the Kurdyka-Lojasiewicz inequality in the 
Riemannian context and recall some basic notions on o-minimal structures on (M, -|-, •) and 
analytic-geometric categories. In Section 5 we present an abstract converge analysis of 
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inexact descent methods for functions satisfying Kurdyka-Lojasiewicz inequality. In Section 6 
we recall the exact proximal point method in the Riemannian context an inexact version of 
it in that context. Finally, in Section 7 we recall the gradient method in the Riemannian 
context and we extend some the convergence results for KL functions. 

2 Preliminary of Riemanian Geometry 

In this section, we introduce some fundamental properties and notations of Riemannian 
manifold. These basics facts can be found in any introductory book to Riemannian geometry, 
such as in do Carmo [12] or Sakai [39]. 

Let M be a n-dimentional connected manifold. We denote by T^M the n-dimentional 
tangent space of M at x, by TM = U^^mTxM tangent bundle of M and by X{M) the space 
of smooth vector fields over M. When M is endowed with a Riemannian metric (. , .), with 
the corresponding norm denoted by ||.||, then M is a Riemannian manifold. Remember that 
the metric can be used to define the length of piecewise smooth curves 7 : [a, 6] — >■ M joining 
X to y, i.e., such that 7(a) — x and 7(6) = by: 



and, moreover, by minimizing this length functional over the set of all such curves, we obtain 
a Riemannian distance d{x,y) inducing the original topology on M. We denote by B{x,e) 
the Riemannian ball on M with center x and radius e > 0. The metric induces a map 

/ I— grad/ G X{M) which, for each function smooth over M, associates its gradient via the 
rule (grad/, X) = df{X), X G X{M). Let V be the Levi-Civita connection associated with 
(M, ( , )). In each point x G M, we have a linear map Ax{x) : T^M T^M defined by: 



li X = grad/, where / : M — )■ M is a twice differentiable function, then Ax{x) is the Hessian 
of / at X and is denoted by Hess/. A vector field V along 7 is said to be parallel if V^'V — 0. 
If 7' itself is parallel we say that 7 is a geodesic. Given that the geodesic equation V -y/7' = 
is a second-order nonlinear ordinary differential equation, we conclude that the geodesic 
7 = 7t,(.,a;) is determined by its position x and velocity v at x. It is easy to verify that 
1 1 7' 1 1 is constant. We say that 7 is normalized if ||7'|| = 1. The restriction of a geodesic 
to a closed bounded interval is called a geodesic segment. A geodesic segment joining x to 
y in M is said to be minimal if its length equals d{x., y) and the geodesic in question is 
said to be a minimizing geodesic. If 7 is a geodesic joining points x and y in M then, for 




Ax{x)v = V^X 



(2.1) 
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each t e [a,b], V induces a linear isometry, relative to (, ), P^(^a)-r{t) '■ T^(a)M — )■ T^(^t)M, 
the so-called parallel transport along 7 from 7(a) to ^{t). The inverse map of P^(^a)'y{t) is 
denoted by P^(^a)'~i{t) '■ '^lit)^ ~^ T^ia)M. In the particular case of 7 to be the unique geodesic 
segment joining x and then the parallel transport along 7 from a; to y is denoted by 
P^y : T^M ^ TyM. 

A Riemannian manifold is complete if the geodesies are defined for any values of t. Hopf- 
Rinow's theorem (see, for example, Theorem 2.8, page 146 of [12] or Theorem 1.1, page 84 of 

[39]) asserts that if this is the case then any pair of points, say x and in M can be joined 
by a (not necessarily unique) minimal geodesic segment. Moreover, (M, d) is a complete 
metric space so that bounded and closed subsets are compact. From the completeness of 
the Riemannian manifold M, the exponential map exp^, : T^M — >■ M is defined by exp^ v — 
7^(1, x), for each x e M. We denote by ^^(O-r) the ball in the tangent space T^M with center 
Oa; and radius e > 0. Since the Dexp^.(Oa;) is the identity, then by inverse mapping theorem 
there exists an e > such that exp,j. |_b,(o^) is a diffeomorphism onto an open set lAx in M 
containing x. We call the open set lAx a normal neighbourhood of x. It can be shown that, 
for each v e i?e(Oa;), 

y ^ expx{v) eUx^ d{x,y) ^\\v\\. (2.2) 

We denote by R the curvature tensor defined by R{X, Y) — VxVyZ— Vy Vx-^— V[y,x]-Z^, 
with X,Y,Z e X[M), where [-Y, V] = YX — XY. Moreover, the sectional curvature as 
related to X and Y is given by K{X,Y) = {R{X,Y)Y, X)/{\\X\\^\\X\\^ - (X, Y)^), where 
||X|| = {X,Xy. If K{X,Y) ^ for aU X and Y, then M is called a Riemannian manifold 
of nonpositive curvature and we use the short notation K ^0. 

A complete, simply connected Riemannian manifold of nonpositive sectional curvature 
is called a Hadamard manifold. It is known that if M is a Hadamard manifold, then M has 
the same topology and differential structure of the Euclidean space M", see for example [12. 
Lemma 3.2, page 149] or [39, Theorem 4.1, page 221]. Furthermore, some similar geometrical 
properties are known of the Euclidean space M", such as that where, given two points, there 
exists an unique geodesic segment that joins them. 

In this paper M denote a complete n- dimensional Riemannian manifold. 

3 Nonsmooth analysis on manifold 

In this section we present elements of nonsmooth analysis on manifold, which can be found, 
for example, in YU et al [30]. 

Let / :M— )-MU{+oo}bea real extended- valued function and denoted by 

dom/ := {x e M : f{x) < +00} 
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its domain. We recall that / is said to be proper when dom/ ^ 0. 

Definition 3.1. Let j he a lower semicontinuous function. The Frechet-subdifferential of f 
at X E M is defined by 



df{x) 



{dhx : h e C^(M) and f — h attains a local minimum atx}, if x & domf 
0, if X ^ domf, 



where dh^ G (T^M)* is given by dhx{v) — (grad h{x) , v) , v e T^M. 

Note that if / is differentiable at x, then df{x) = {gradf{x)}. 

Definition 3.2. Let f be a lower semicontinuous function. The (limiting) subdijferential of 
f at X & M is defined by 

df{x) := {v e T^M : 3(x'^,^;") e Graph{df) with (x'*,^;") ^ {x,v), fix"") f{x)}, 

where Graph{df) := {{y,u) eTM:ue df{y)}. 

It follows directly from Definitions 3.1 and 3.2 that df{x) C df{x). Note also that, df{x) 
may be empty, but if / attains a local minimum at x, then ^ df{x). A necessary (but not 
sufficient) condition for x e M to be a minimizer of / is 

e df{x). 

A point X & M satisfying the above inclusion is called limiting-critical or simply critical. 

Proposition 3.1. Let / : M — )■ R U {+00} be a lower semicontinuous function. Suppose 
that {U, 0) is a local coordinate neighborhood and x E U. Then, 

df{x) = mdUor'mx)), 

where 0* denote the Frechet derivative adjunct of the function 0. 

Proof See [30, Corollary 4.2]. □ 



4 Kurdyka-Lojasiewicz inequality on Riemannian man- 
ifolds 

In this section we present the Kurdyka-Lojasiewicz inequality in the Riemannian context 
and recall some basic notions on o-minimal structures on (R, -|-, •) and analytic-geometric 
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categories. Our main interest here is to observe that the Kurdyka-Lojasiewicz inequahty, in 
Riemannian context, holds for lower semicontinuous functions, not necessarily differentiable. 
The differentiable case was presented by Lageman [28, Corollary l.f.25]. It is important 
to note that Kurdyka et al. [27] had already established such inequality for analytic mani- 
folds and analytic functions. For a detailed discussion on o-minimal structures and analytic 
geometric categories see, for example. Dries and Miller [17], and references therein. 

Let / : M — > IR U {+00} be a proper lower semicontinuous function and we consider the 
following sets: 

. distiO,dfix)) := inf{\\v\\ : v e df{x)}, 

• [rji < f < r]2] := {x e M : r]i < f{x) < 772}, -00 < r]i < m < 

Definition 4.1. The function f is said to have the Kurdyka-Lojasiewicz property at x & 
dom Of if there exists rj e (0, +00], a neighborhood U ofx and a continuous concave function 
ip : [0,r]) — )■ M+ such that: 

(i) (^(0) = 0, e C^(0,r;) and, for all s e (0,77), Lp'{s) > 0; 

(a) for all X & U n [f (x) < f < f{x) + rj], the Kurdyka-Lojasiewicz inequality holds 



We call f a KL function, if it satisfies the Kurdyka-Lojasiewicz inequality at each point of 
domdf . 

Next we show that if a; is a noncritical point of a lower semicontinuous function then the 
Kurdyka-Lojasiewicz inequality holds in x. 

Lemma 4.1. Let / : M — )■ R U {+00} be a proper lower semicontinuous function and 
X e domdf such that ^ df{x). Then, the Kurdyka-Lojasiewicz inequality holds in x. 

Proof. Since x is a noncritical point of / and df{x) is a closed set, we have that 

5 := dist{0,df{x)) > 0. 
Take (p{t) :— t/5, U :— B{x,5/2), r] :— 5/2 and note that, for each x e dom9/. 



'p'Uix) - f{x))dist{Q,df{x))>l. 



(4.1) 



f{x))dist{0, df{x)) = dist{0, df{x))/5. 



(4.2) 



Now, for each x E U n[f{x) 



r] < f < f {x) -\- Tj] arbitrary, note that 



d{x,x) + \f{x)-f{x)\<S. 
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We state that, for each x satisfying the last inequahty, it holds 

dist{0, df{x)) > S. (4.3) 

Let us suppose, by contradiction, that this does not holds. Then, there exist sequences 
C GraphS/ and {S''} C R++ such that 

d{y\x) + \f{y'')-f{x)\<6\ and \\v''\\ < 6\ 

with {S''} converging to zero. Thus, using that {{y'', w^)} and {/(y'^)} converge to (x, 0) and 
f{x) respectively, and df is a closed mapping, it follows that x is a critical point of /, which 
proves the statement. Therefore, the result of the lemma follows by combining (4.2) with 
(4.3). □ 

It is known that a C^-function / : M — > M is a Morse function if each critical point x of 
/ is nondegenerate, i.e, if Hess/(a;) has all its eigenvalues different of zero. From the inverse 
function theorem it follows that the critical points of a Morse function are isolated. It is also 
known, see [22, Theorem 1.2, page 147 ], that Morse functions form a dense and open set in 
the space of C^-f unction, more precisely 

Theorem 4.1. Let M be a manifold and denote by C^(M, R), the set of all the -functions 
g : M R. The collection of all the Morse functions form a dense and open set in C^(M, R), 
2 < r < +00. 

Let / : M — > R be a Morse function and x e M be a critical point of /, and take 
U — B[x, S) C such that it docs not contain another critical point. Using the Taylor 
formula for / and grad/ and taking into account (2.2), we obtain, for a; e C/ 

f{x)-f{x) = ^{}iessf{x)exp^^x,exp^^x) + o{d^{x,x)), 

grad/(x) = Hess f{x) expj''" x + o{d{x, x)), 

Reducing the size of the radius 6, if necessary, we can ensure the existence of positive 
constants 6i, 62 such that 

\f{x) — f{x)\ < did^{x,x) and S2d{x,x) < ||grad/(a;)||. 

Prom the last two inequalities, it is easy to verify that (4.1) holds with (p{s) — 2\/&[s/52, 
U = B{x,5) and rj — 5. Therefore, it follows from Lemma 4.1 that the Morse functions are 
KL functions. 
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Remcirk 4.1. It should be pointed that the last examples, amongst other things, also have 
appeared in [6] in the Euclidean context. For examples illustrating failure of this property 
see, for instance, [1, 9, 10]. 

Next we recall some definitions which refer to o- minimal structures on (R, +, •), following 
the notations of Bolte et al.[10]. 

Definition 4.2. Let O = {CnjnGN be a sequence such that each On is a collection of subsets 
o/R". O is said to be an o-minimal structure on the real field (R, +, •) if, for each n e N; 

(i) On is a Boolean Algebra; 

(ii) If On, then A x R e On+i and R x >1 e 

(Hi) If A & On+i, then 7r„(A) e On, where 7r„ : R"+^ — >■ R" is the projection on the first n 
coordinates; 

(iv) On contains the family of algebraic subsets ofW; 

(v) Oi consists of all finite unions of points and open intervals. 

The elements of O are said to be definable in O. A function / : R" — > R is said to be 
definable in O if its graph belongs to On+i- Moreover, according to Coste [14] / : R" — )■ 
R U {+c>o} is said to be definable in O if the inverse images of /^-'^(+cxo) is definable subset 
of R" and the restriction of / to /^^(R) is a definable function with values in R. It is 
worth noting that an o-minimal structure on the real field (R, +, •) is a generalization of a 
semialgebraic set on R", i.e., a set that can be written as a finite union of sets of the form 

{x -.piix) =0, qi{x)<0, t = l,...,r}, 

with Pi,qi, i = l,...,r, being real polynomial functions. Bolte ct al. [10], presented a 
nonsmooth extension of the Kurdyka-Lojasiewicz inequality for definable functions, but in 
the case that the function ip, which appears in Definition 4.1, is not necessarily concave. 
Attouch et al. [6] , reconsidered the said extension by noting that ip may be taken concave. 
For an extensive list of examples of definable sets and functions on an o-minimal structure and 
properties see, for example, [17, 6], and references therein. We limit ourselves to presenting 
just the material needed for our purposes. 

The first elementary class of examples of definable sets is given by the semi-algebraic sets, 
which we denote by Ra/g- An other class of examples, which we denoted by R^n, is given by 
restricted analytic functions, i.e., the smallest structure containing the graphs of all / |[o,i]" 
analytic, where / : R" — >■ R is an arbitrary function that vanishes identically off [0, 1]". 
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Fulfilling the same role as the semi- algebraic sets on X, on analytic manifolds we have 
the semi-analytic and sub-analytic sets which we define below, see Bierstone and Milman[8], 
Dries [16]: 

A subset of an analytic manifold is said to be semi-analytic if it is locally described by 
a finite number of analytic equations and inequalities, while the sub-analytic ones are local 
projections of relatively compact semi-analytic sets. 

A generalization of semi-analytic and sub-analytic sets, analogous to what was given to 
semi-algebraic sets in terms of the o-minimal structure, leads us to the analytic-geometric 
categories which we define below: 

Definition 4.3. An analytic- geometric category C assigns to each real analytic manifold 
M a collection of sets C{M) such that for all real analytic manifolds M, N the following 
conditions hold: 

(i) C{M) is a Boolean Algebra of subsets of M , with M e C{M); 
(a) IfAe C{M), then AxRe C{A x R); 

(Hi) If f : M ^ N is a proper analytic map and A e C{M), then f{A) e C{N); 

(iv) If A <Z M and {Ui \ i & A.} is an open covering of M, then A e C{M) if and only if 
Ar\Uie C{Ui), for all i e A; 

(v) Every bounded set A e C(M) has finite boundary, i.e. the topological boundary, dA, 
consists of a finite number of points. 

The elements of C{M) are called C-sets. If the graph of a continuous function / : A — > 
B with A e C(M),B e C(N) is contained in C(M x N), then / is called a C-function. 
All subanalytic subsets and continuous subanalytic map of a manifold are C-sets and C- 
functions respectively, in that manifold. We denoted this collection by Can which represents 
the 'smallest' analytic-geometric category 

The next theorem provides a biunivocal correspondence between o-minimal structures 
containing Wan and an analytic-geometric category 

Theorem 4.2. For any analytic- geometric category C there is an o-minimal structure 0{C) 
and for any o-minimal structure O on Ran there is an analytic geometric category C{0), 
such that 

(i) A e C{0) if for all x & M exists an analytic chart 4> : U MJ^ , x & U, which maps 
AnU onto a set definable in O. 
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(ii) A e 0{C) if it is mapped onto a bounded C-set in Euclidean space by a semialgebraic 
bijection. 

Furthermore, for C — C{0) we get back the o-minimal structure O by this correspondence, 
and for O — 0{C) we again get C. 

Proof. See [17] and [28, Theorem 1.1.3]. □ 

As a consequence of the correspondence between o-minimal structures containing 
and analytic-geometric categories, the definable sets associated allow us to provide examples 
of C-sets in C{0). Furthermore, C-functions are locally mapped to definable functions by 
analytic charts. 

Proposition 4.1. Let f : M ^ W be a C-function and (f) : U ^ R", U C M an analytic 
local chart. Assume that U C domf and V (Z M is a bounded open set such that V (Z U. If 
f restricted to U is a bounded C-function, then 

/o0-i:0(T/)^R, 

is definable in 0{C). 

Proof. See [28, Proposition 1.1.5.]. □ 

The next result provided us a nonsmooth extension of the Kurdyka-Lojasiewicz inequality 
for C-functions defined on analytic manifolds. 

Theorem 4.3. Let M be a analytic Riemannian manifold and f : M ^ M. a continuous 
C-function. Then, f is a KL function. Moreover, the function </? which appears in (4.1) is 
definable in O. 

Proof. Take a; G M a critical point of / and let (f) : V ^ M" be an analytic local chart 
with V d M a, neighbourhood of x chosen such that V and fiV) are bounded. Thus, from 
Proposition 4.1, we have that h = f o(j)~^ : (j){V) — > R is a definable function in 0{C). Thus, 
as 4>{V) is a bounded open definable set containing y = (p{x) and 4> is definable, applying 
Theorem 11 of [10] with U — (piV) and taking into account Theorem 4.1 of [6], Kurdyka- 
Lojasiewicz inequality holds at y = 0(5;), i.e., there exists 77 e (0, -|-oo] and a continuous 
concave function $ : [0, 77) ^ R+ such that: 

(i) $(0) = 0, $ e Ci(0,r7) and, for all s e (0,7^), $'(s) > 0; 
(u) for all 1/ e ?7 n [h{y) < h < h{y) + r]], it holds 

<^'{h{y)-h{y))dist{0,dh{y))>l. 
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Since is a diffeomorphism and using that y — (j){x), y = 4>{x) and h — f o cj) ^, from 
Proposition 3.1 last inequality yields 

<^>'{f{x) - fix))dzstiO, {(PX'dfix)) >1, xeVn[0<f< fix) + rj], 

where (/>* denote the Frechet derivative adjunct of the function (j). 

Take V C V an open set such that K = V is contained in the interior of the set V and 
X e v. Thus, is a compact set and for each x E K there exists Cx > with 

\\{(f)l)-^w\\ < Cx\\w\\, wenM. 

Since K is a compact set and (0*)^^ is a diffeomorphism, there exists a positive constant 
c := sup{cj; : x G K} such that 

< c||w||, weTxM,xeK. 
Hence, ior x e V f] [0 < f < f{x) + rj], we have 

1 < - f{x))dzst{0, {(Pir'dfix)) < c<l>\f{x) - f{x))dist{0,df{x)), 

and the Kurdyka-Lojasiewicz inequality holds at x with = c$. Therefore, combining 
arbitrary of x with Lemma 4.1 we conclude that / is a KL function. The second part also 
follows from Theorem 11 of [10] and the proof is concluded. 

□ 

The following result provided us a nonsmooth extension of the Kurdyka-Lojasiewicz 
inequality for definable functions defined on submanifolds of Euchdean space. Coste [14] 
devotes Chapter 6 to estabhsh properties of such submanifolds. 

Theorem 4.4. Let / : M C M" ^ M U {+00} be proper lower semicontinuous definable 
function in an o-minimal structure O. If M is endowed with the induced metric of Euclidean 
space, then f is a KL function. Moreover, the function (f which appears in (4.1) is definable 
in O. 

Proof. Take x E M a, critical point of / and W a bounded definable subset of IR" such 
that X G W. Since dom/ and W are definable sets in and W is bounded, it follows 
that dom/ fl is a bounded definable set in W\ Thus, applying Theorem 11 of [10] with 
U = dom/ n W and, taking into account Theorem 4.1 of [6], the Kurdyka-Lojasiewicz 
inequality holds at x. Therefore, combining arbitrary of x with Lemma 4.1, we conclude the 
first part of the theorem. The second part also follows, of Theorem 11 of [10] and the proof 
is concluded. □ 
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Reiricirk 4.2. A large class of examples of definable submanifolds of Euclidean space are 
given by manifolds which are obtained as reverse image of regular value of a definable func- 
tion, more precisely, if F : M"^''" M.'^ is a definable function and "0" is a regular value 
of F, then M = F~^(0) is a definable submanifold o/M". Moreover, via the Nash Theorem 
([34.]), we can isometrically imbed in some M" a small piece y of M, which is a regular sub- 
manifold ofMT'. Indeed, ife>Ois small enough, then the set of normal segments of radius e 
centered at points ofy determine a tubular neighbourhood V ofy. Clearly, V has a natural 
coordinate system given by y = {x,t) & y x B^{(}), where -Be(O) C is an e-ball (here, 
n — m, m < n, is the dimension of M). We identify (x, 0) with x. Define h{x,t) = t. It is 
obvious that h is a definable function and y = {y & V; h{y) = 0} is a definable submanifold 
ofW. 

5 An abstract convergence result for inexact descent 
methods 

In this section we present an abstract converge analysis of inexact descent methods for 
functions satisfying Kurdyka-Lojasiewicz inequality at a given critical point. Throughout 
this section / denotes a proper lower semicontinuous function / : M ^ MU {+00}. 
Next we present the definition of quasi distance. 

Definition 5.1. A mapping D : M x M ^ M+ is said to be a quasi distance if: 

(i) for all x,y & M, D{x, y) = D{y, x) = 4^ x = y; 

(ii) for all x,y,z & M, D{x, z) < D{x, y) + D{y, z). 

If D is also symmetric, that is, D{x, y) = D{y, x), x,y & M, then D is a distance. Given 
X E M and e > fixed, we denote by Bd{x, e) the ball with respect to the quasi distance D 
defined by 

BD{x,e) = {yeM: D{y,x)<€}. 

Throughout this section we assume that, for each y e M, D{.,y) is continuous. 
Let a and b be fixed positive constants and {x^} an arbitrary sequence satisfying the 
following assumptions, 

HI. For each keN, 

f{x^+^) + aD\x^+\x^) < f{x^)- 
H2. For each /c G N, there exists G df{x^^^) such that 

Ww^^^W < bD{x^+\x^)- 
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H3. / restricted to dom/ is continuous; 

H4. X^fc^ x*^) < +00 implies that {x'^} is convergent on M. 

Remark 5.1. From assumption H2 it is immediate that if x^^^ — x^ for some k, then x^ is 
a critical point of f . Note also that if D is Riemannian distance then assumption H4 holds 
(Hopf-Rinow's theorem). However, even in the Euclidean case there exists a particular class 
of quasi distances that not necessary are distances but satisfy the assumption H4, see [33]. 

From now on, in this section, we assume that {x^} is a sequence satisfying assumptions 
HI, H2, H3 and H4. Moreover, taking into account the first part of Remark 5.1 we assume 
that x^^'^ ^ x^ for all k. 

Next, we present one technical result that could be useful in convergence analysis. 

Lemma 5.1. Let {ak} be a sequence of positive numbers such that 

+00 

y^afc/gfc-i < +00. 

k=l 

Then, Ylk=i^k < +00. 
Proof Take j e N fixed. Note that, 
j j 

= V! ; Vdk-i < 

k=l fe=l V « ^ 

where the above inequality follows from Cauchy-Schwartz inequality in W with respect to 
the vectors (oi/ ^/ao, . . . , %/ i/oj-i) {^/^^ ■ ■ ■ ^ ■ So, 

k=i \k=i "^=-1 

Now, adding gq to both sides of the last inequality and taking into account that aj > 0, we 
obtain 

y] ak-i < oo + I 
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Therefore, dividing both sides of last inequality by ( Yl'l^i Ofc-i ) and observing that 

'2 

< ^/o^ (ofe > 0, /c = 0, 1, . . .), 



it follows that 

(si! 

and the desired result follows by using simple arguments of real analysis. □ 

In the following theorem we prove the full convergence of the sequence {x^} to a critical 
point of functions which satisfy the Kurdyka-Lojasiewicz property in that point. 

Theorem 5.1. Let U, rj and if : [0,77) — >■ 1R+ he the objects appearing in the Defimtion 
Assume that a:° G domf , x E M is an accumulation point of the sequence {x'^}, p > is 
such that Bd{x,p) C U and f satisfies the Kurdyka-Lojasiewicz inequality at x. Then there 
exists /co £ N such that 

+00 

^D{x^+\x^) <+oo. (5.1) 

fc=fco 

Moreover, /(a;^) — )■ f{x), as k ^ +00, and the sequence {x^} converges to x which is a 
critical point of f. 

In order to prove the above theorem we need some preliminary results over which we 
assume that all assumptions of Theorem 4.1 hold, with the exception of HI, H2, H3 and 
H4, which will be assumed to hold only when explicitly stated. 

Lemma 5.2. Assume that assumptions HI and H3 hold. Then there exists ko & N such 
that 

f{x)<f{x'')<f{x)+ri, k>ko, (5.2) 



D{x'^", i) + 2 J ^^"^^ + \{f{x'°) - fix)) < p. (5.3) 

V a a 

Moreover, i/H2 holds, then 

-w{x'°) - fix)) - m^'°^') - fim > (5.4) 

In particular, if x^ E Bd(x,p) for all k > ko, then Ylk=ko D(x'^'^^,x'^) < +00 and, assuming 
that H4 holds, the sequence {x'^} converges to x. 
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Proof. Let {x''^} be a subsequence of {x^} converging to x. Now, from assumption HI 
combined with x^ G dom/ and a > 0, we obtain that x^ e dom/, for all j G N (in particular 
X G dom/). Thus, from assumption H3 and taking into account that lim^^+oo 3^*^^ = x, 
it follows that {/{x''^)} converge to f{x). Since {/{x'')} is a decreasing sequence (it holds 
trivially of the assumption HI), we obtain that the whole sequence {f{x^)} converges to 
f{x) as k goes to +00 and, hence 

fix) < fix''), keK (5.5) 

In particular, there exists N E N such that 

fix)<fix'')<fix)+r), k>N. (5.6) 

Since (5.5) holds, let us define the sequence {bk} given by 

h = Dix',x) + _ /(^)). 

V a a 

As Di.,x) and (p are continuous it follows that is an accumulation point of the sequence 
{bk} and hence there exists /cq := kj^ > N such that (5.3) holds. In particular, as ko > N, 
from (5.6) it also holds (5.2). 

From (5.2) combined with x''° G BDix^p) (it follows from (5.3)), we have that 

x'^" G Boix, p) n [fix) <f< fix) + T)]. 

So, since x is a point where / satisfies the Kurdyka-Lojasiewicz inequality it follows that 
^ dfix''°). Moreover, assumption H2 combined with the definition of distiO,dfix'^)), 
yields 

bDix^x'''^) > > distiO,dfix'')), = 1,2,.... 

Thus, again from the Kurdyka Lojasiewicz inequality of / at x, it follows that 

f'{f{x''°) - fix)) > , , ,\ (5.7) 
^^•'^ ' ■'^ >^ - bDix^",x''"-^) ^ ' 

On the other hand, the concavity of the function ip implies that 

<^(/(^'°) - f{x)) - vifix'^^') - fix)) > v'ifix'^) - fix))if{^'°) - f{x'"'^% 
which, combined with (p' > and assumption HI yields 

M^"'') - m) - M^'"^') - m)) > - fix))aD'ix'"'+\x'''). 

Therefore, (5.4) follows by combining the last inequahty with (5.7). 

The proof of the latter part follows from (5.4) combined with Lemma 5.1 and assumption 
H4, which concludes the proof of the lemma. □ 
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Lemma 5.3. Assume that assumptions HI, H2 and H3 hold. Then, there exists a ko 
such that 

x'^eBoix^p), k>ko. (5.8) 

Proof. The proof is by induction on k. It follows trivially from the HI that sequence {f{x'')} 
is decreasing and 

D{x'+\ x'') < ^jMHI^^^ ken. (5.9) 

Moreover, as H3 also holds, from Lemma 5.2 it follows that there exists /cq G N such that 
(5.3), (5.2) hold and, hence 

x^^ e Bd{x,p), < /(a;^«) -/(x'^^+i) < f{x'")-f{x), (5.10) 

which, combined with (5.9) {k = ko), give us 



D{x'">+\ x"") < \j /(^'°)^ /(^) . (5.11) 



Now, from the triangle inequality, combining with the last expression and (5.3), we obtain 



D{x^'+\ x) < y •^^^'°)^ •^^^) + D{x^\x) < p, 

which implies that x^°'^^ e B£,{x,p). 

Suppose now that (5.8) holds for all A; = /cq + 1, ■ ■ ■ , + J — 1- In this case, for k — 
/co + 1, . . . , /co + J — 1, it holds (5.4) and, consequently 

VL'(x^x'=-l)(6/a)[(^(/(x'=) - f{x)) - ip{f{x''+^) - f{x))] > D{x''+\ x''). (5.12) 
Thus, since for r, s > it holds r + s > 2y/rs, considering, for A; = fco + 1, . . . , fco + J — 1 

r = D{x\ x'-% s = (V«)b(/(^') - /(^)) - <^(/(^'+') - f{x))i 
from the inequality (5.12), it follows, lor k — k^ -\- 1, . . . ,kQ -\- j — 1, that 

2D{x^+\x^) < D{x\x^-') + %{f{x^) - fix)) - ^{f{x^^') - fim- 

a 

So, adding member to member, with /c = /cq + 1, . . . , /cq + J — 1, we obtain 

y D{x'+^, x') + D{x^°^\ x^°^^-^) < D{x''°+\ x''°) + -[(fi{f{x^°+') - fix)) 

i=ko+l 

-(^(/(x'=°+^)-/(x))], 
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from which we obtain 

ko+j-l , , 

y D(x'+\x') < D(x''°-^\x''°) + -ip(f(x''°+')-f(x)) < D(x''°+\x''') + -ip(f(x'''>)-f(x)) 
' a a 

i=ko+l 

(5.13) 

where the last inequahty follows of the second inequality in (5. 10) and because (f is increasing. 
Now, using the triangle inequality and taking into account that D{x, y) > for all x,y & M, 
we have 

fco+i-i 

D{x'"'+^, x) < D{x^^+\ x^°) + D{x^\ x) < D{x^\x) + a;*^°) + D{x'+\ x'), 

i=fco+l 

which, combined with (5.13), yields 

D{x^^+\ x) < D{x''\x) + 2D{x^°+\ x^') + -cp{f{x''") - f{x)). 

a 

Therefore, from the last inequality, combined with (5.11) and (5.3), we conclude that x^°^^ e 
Bd{3:,p), which completes the induction proof. □ 



Proof of Theorem 5.1 

Note that Lemma 5.3 combined with Lemma 5.2 implies that (5.1) holds and, in particular, 
that the sequence {x''} converge to 5 G M. Thus, from the assumption H3 combined 
with assumption HI, it follows /(x*^) — )■ f{x), as k ^ +oo. Now, combining (5.1) with 
assumption H2, it follows that {{x'',w'')} converges {x, 0) as k goes to +oo. Therefore, from 
Definition 3.2 we conclude that e df{x), which tell us that x is a critical point of /. 



6 Inexact proximal method for KL functions on Rie- 
mannian manifold 

In this section we recall the exact proximal point method in the Riemannian context proposed 
by Ferreira and Oliveira [18] and propose an inexact version of it in that context. 
Consider the following optimization problem 

min/(a;) , . 

s.t. X e M, ^ > 

where / : M — > R U {+00} is a proper lower semicontinuous function bounded from below. 
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The proximal point method to solve optimization problems of the form (6.1) generates, 
for a starting point x° e M, a sequence {x'^} C M as it follows: 

x'+' e argmin^,^ |/(y) + ^d\y,x')^ , (6.2) 

where {\k} is a sequence of positive numbers. In the particular case that M is a Hadamard 
manifold, dom/ = M and / is convex, Ferreira and Oliveira [18] proved that for each 
k E N the function /(.) + (P{.,x'') : M — >■ R is 1-coerciva and, consequently, the well 
definedness of the sequence {x*^} with x^'^^ being uniquely determined. Moreover, considering 
J2k=o V^fc = that / has minimizer, the authors proved convergence of the sequence 

{f{x^)} to the minimum value and convergence from the sequence {x^} to a minimizer point. 
Note that from (6.2) combined with the assumption of convexity of the function / and first 
order optimality condition associated to the subproblem (6.2), 

f{x'-'') + ^d'{x'+\x')<f{x% (6.3) 

ykeN, 3 w''+^ e df{x''+^), (6.4) 

\\w''+^\\^Xkd{x''+\x''). (6.5) 

Next we present an inexact version of the proximal point method in the Riemannian 
context. 

Take x° G dom/, < A < A < +oo, b > and 9 e (0, 1]. For each /c = 0, 1, . . ., choose 
Afc e [A, A], and find x''+^ e M, w''+^ e T^k+iM such that 

fix'^') + ^-^D'{x'^\x')<f{x% (6.6) 

ykeN, 3 w''+^ e df{x''+^), (6.7) 
\\w''+^\\ <b\kD{x''^\x''), (6.8) 
where D : M x M ^ M. is a. quasi distance continuous. 

Remark 6.1. Note that if 6 = 6 = 1, (6.8) holds with equal, D is the Riemannian distance d, 
M is a Hadamard manifold, domf = M and f is convex, and we recover the exact proximal 
point method generated by (6.3), (6.4) and (6.5). On the other hand, if M = M" and D is the 
Euclidean distance, we are with the inexact version of the proximal point method proposed 
by Attouch et al., in [5]. 
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Theorem 6.1. Let f : M — >■ ]RU{+oo} be a proper lower semicontinuous KL function 
which is bounded from below. Moreover, assume that assumption H3 holds. If a sequence 
{a:^} generated by (6.6), (6.7) and (6.8) is bounded and D satisfies assumption H4, then it 
converges to some critical point x of f . 

Proof. Since {x^} is bounded, by Roph-Rinow's theorem the sequence {x^} has an accu- 
mulation point on M. Let x be an accumulation point of {x^} and {x^'^} a subsequence 
converging to x. Now, from (6.6) combined with G dom/ and 9 G (0, 1], we obtain that 
G dom/, for all j G N (in particular x G dom/). Therefore, as assumption HI holds 
with a — {dX)/2, assumption H2 holds by the definition of the method and assumptions 
H3 and H4 hold by the assumption of the theorem, the result follows by directly applying 
Theorem 5.1. □ 



7 Inexact descent method for KL functions on Rie- 
mannian manifold 

In this section we recall the gradient method in the Riemannian context to solve optimization 
problems of the form (6.1) in the case that dom/ = M and / is a function, and extend 
the convergence results estabhshed by da Cruz Neto et al. [15] and Papa Quiroz et al. 
[36] , respectively, for convex and quasiconvex functions on Riemannian manifolds of positive 
curvature, for KL functions on Hadamard manifolds. 

7.1 The steepest descent method with some known stepsize rule 

Given x° G M, the classic steepest descent method generates a sequence {x''} given by 

x^+^ = exp,.(-tfegrad/(a;'=)), (7.1) 

where exp is the exponential map and tk is some positive stepsize. 
Armijo seeirch: If the sequence {tk} is obtained by 

tk := max{2-^' : / G N, / (exp,.(2-^grad/(x^')) < fix") - a2'^ ||grad/(x'=)||=^} , (7.2) 

with a G (0,1), we are with the Armijo search. Note that, in this case, zero can be an 
accumulation point of the sequence {tk}. However, when / is L-Lipschitzian gradient (see 
next definition) zero is not accumulation point of the sequence tk- 
The next definition was proposed by da Cruz Neto et al. [15]. 
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Definition 7.1. Let f : M be a function and L > 0. f is said to have L-Lipschitzian 
gradient if, for any x,y & M and any geodesic segment 7 : [0, r] — >■ M joining x and y, we 
have 



where l(t) denotes the length of the segment between 7(0) = x and ^{t). In particular, if M 
is a Hadamard manifold, then the last inequality reduces to 



Fixed step(See Burachik et al. [11] and da Cruz Neto et al. [15]) 

Given 61,62 > such that L61 + 62 < 1, where L is the Lipschtz constant associated to 
grad/, if sequence {tk} is such that 



we are with the fixed step rule. 

Let us now consider the following assumption: 

Assumption 7.1. There exists a function : 1R+ — >■ 1R+ such that 

a) There exist a e (0, 1) and Ta > 0, such that \/t e (0, Tq], (pit) < at; 

b) There exist /3 > and Tp e (0, +00], such that \/t e (0, Tp] n R, (j){t) > (5t^; 

c) For all A; = 0, 1, . . f{x^+^) < f{x^) - (t){tk)\\gradf {x^)f and Q<tk<Tp in (7.1); 

d) There exist 7 > 1, > 0, such that Wk, t^ > or 

there exists h G [ife,7^fe] : fi^^Wx^i-hgradfix'')) > f{x^) - (j){ik)\\gradf {x'')f . 

Remark 7.1. The above assumption was first considered by Kiwiel et al. [25] in the Eu- 
clidean conteoct. They observed that the steepest descent methods with Armijo search and 
fixed step both satisfy Assumption 7.1 with 



\gradf{j{t)) - P^(aMt)9radf{x)\\ < rl{t), 



te[0,r], 



\\gradf{^{t)) - P^^^t)gradf{x)\\ < rd{-f{t),x), 



te[0,r]. 




4>{t) = at, (3 = a, 7 = 2 and Ta = Tf^ = = 1 



and 



Pt\ (3 = 



62L 



Tj = 61, Ta 



L 



a e (0, 1) Ta = a//3, 



2(1-^2)' 



2(1-^2)' 
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respectively. Under Assumption 7.1, quasi convexity of the function f and that the solution 
set of the problem (6.1) is not-empty, Kiwiel et al, proved full convergence of the sequence 
generated by the method to a critical point. Papa Quiroz et al. [36], considering Assump- 
tion 7.1, generalized the convergence result presented in [25] to the Riemannian context in 
the particular case that M has nonnegative curvature. 

Considering a sequence {x^}, generated by (7.1), satisfying Assumption 7.1 with the 
following reformulation of the item d) , 

3 ^ > 1, > : tk > r^, A; = 0, 1, ... , (7.3) 

then, we have at least the steepest descent method with Armijo search and with fixed step 
(in the case that the objective function is L-Lipschitzian gradient) which satisfies those 
assumptions. 

7.2 General convergence result 

Next we present a general descent method to solve the optimization problem (6.1). From 
now on, in this section / denotes a function with L-Lipschitz gradient. 

Given ri,r2 > 0, and x° e M, consider the sequence {x''} generated as follows: 

f(x''+^) + riD\x''+\ x^) < fix'); (7.4) 

||grad/(a;^)|| < r2D{x''+\x''), (7.5) 

where L>:MxM—)-M is a quasi distance. Note that if {x''} is generated by (7.1), then 
(7.5) does not necessarily happens. This is due to the fact that the geodesic through x'' with 
velocity — grad/(a;'^) is not necessarily minimal. 

The following lemma provides us a class of sequences which falls into the general category 
delineated by the general descent method (7.4) and (7.5). 

Lemma 7.1. Let {x^} be the sequence generated by (7.1) satisfying Assumption 7.1 with the 
item d) replaced by condition (7.3). Assume that there exists Si,S2 > such that 

sid{x, y) < D{x, y) < S2d{x, y), x,y e M. (7.6) 

Then {x^} satisfies (7.4). Moreover, if M is a Hadamard manifold, then {x'^} also satisfies 
(7.5). 
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Proof. Prom items b) and c) of Assumption 7.1, we obtain 

f{x'+') + (3tk\\9radf{x')f<f{x'). 

Now, from (7.1) it follows that d{x'^'^^ , x'^) < tk\\gradf{x'^)\\ which, combined with last 
inequality and (7.6), yields 

f{x''+^) + -D\x''+\x'') < fix''). 

Thus, (7.4) it holds with ri = (3/ 82- In the particular case that M is a Hadamard manifold, 
then the geodesic through x'' with velocity — grad/(a;^) is minimal and, hence 

d{x''+\x'') = tk\\gradf{x')\\, keN. (7.7) 

Therefore, combining the last equality with first inequality in (7.6) and assumption (7.3), 
the condition (7.5) is obtained with r2 = l/(siT-y), and the proof is completed. □ 

Remark 7.2. Note that we could obtain (7.7) in a more general situation, namely, if the 
injectivity radius of M is bounded from below by a constant r > 0. We recall that the 
injectivity radius of M (see, for example, do Carmo [12, page 271] or Sakai [39, Definition 
4-12, page 110]) is defined by i{M) :— inf{ix : x e M}, where 

ix := sup{e > : expx \B^{id^) is a diffeomorphism} . 

In the particular case that M is a Hadamard manifold i{M) :— +00. If the sectional curvature 
K of M satisfies 

there exists r > such that i{M) > r > (see do Carmo [12, page 275]). However, i{M) 
may be equal to zero for a complete but noncompact Riemannian manifold M, see Sakai [39, 
page 112]. The assumption on injectivity radius was used by Lageman [28, Theorem 2.1.19, 
page 92] and Absil et al. [2, Theorem 7.4.3, page 149]. 

Next, wc present the main result of this section. 

Theorem 7.1. Assume that f is bounded from below and that there exist Si,S2 > such 
that (7.6) holds. If f is a KL function, then each hounded sequence {x''} generated by (7.4) 
and (7.5) converges to some critical point x of f . 
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Proof. The assumption HI follows from (7.4) with a = r\. Note that, 

||grad/(a;^+^)|| = ||grad/(a;'=+^) - P,.,^.+igrad/(a;'=) + P,.,^.+igrad/(a;'=)||, /c e N. 

Thus, from the triangle inequality, using that / has L-Lipschitz gradient and condition (7.5), 
it follows that the assumption H2 holds with h = L+r2- Since {x^} is bounded, by the Roph- 
Rinow's theorem it has an accumulation point on M . Assumption H3 follows immediately 
from the definition of /. Finally, assumption H4 follows trivially of Lemma 5.2 combined 
with the condition (7.6) and Hopf-Rinow's Theorem. Therefore, being / a KL function, the 
result of the theorem follows by directly applying Theorem 5.1. □ 

8 Conclusion 

In this paper we present an unified framework for the convergence analysis of classical descent 
methods when the objective function satisfies Kurdyka-Lojasiewicz inequality. In particular 
we answer Problems 1 and 2 presented in the introduction. 
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